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(54) Device and method for motion vector detection 

(57) According to the invention, a motion vector can 
be accurately and efficiently detected with regard to any 
type of images having a variety, of characteristics. A 
motion vector detection unit detects a motion vector with 
regard to a coding target block on the basis of correla- 
tion with a candidate block within a search range. A 
search range storing memory stores pixel data of an 
original search range, and supplies, to the motion vector 
detection unit, pixel data of a search range in accord- 
ance with a memory address. A control unit sets the 
size and the position of the search range on the basis of 
the motion vector and the correlation evaluation value 
supplied from the motion vector detection unit and gen- 
erates pixel widths in the horizontal and vertical direc- 
tions of the search range and an offset value 
corresponding to the relative position to the original 
search range. An address generation unit generates the 
memory address to be supplied to the search range 
storing memory on the basis of the pixel widths and the 
offset value of the search range generated by the con- 
trol unit. 
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Description 

BACKGROUND OF THE INVENTION 

5 [0001] The present invention relates to motion vector detection used in motion compensative prediction coding, that 
is, a technique of compression coding of digital dynamic image data. 

[0002] As a method of realizing image coding of dynamic images, time redundancy is reduced by using information 
expressing from which portion of a previous picture a given portion of a current picture is moved (i.e., a motion vector). 
One of methods of extracting such a motion vector is designated as a block matching method. 

10 [0003] Figure 16 is a diagram for showing the principle of the block matching method. In the block matching method, 
a target frame image (target frame) to be coded is compared with a search frame image (search frame) in which a 
motion vector is searched for, and a block most similar to (namely, having the highest correlation with) a coding target 
block in the target frame (namely, a best match block) is extracted from a search range in the search frame, thereby 
detecting a motion vector. This block matching method is widely used in the motion compensative prediction for image 

is compression coding. 

[0004] In the block matching method, correlation between one coding target block and plural candidate blocks within 
the search range in the search frame are respectively calculated, and a candidate block having the highest correlation 
is selected as the best match block, so that a positional difference between the best match block and the coding target 
block can be detected as a motion vector. 
20 [0005] As an evaluation value indicating the correlation, an accumulation value of square errors or absolute errors is 
generally used. A difference between a coding target block and a candidate block is smaller as the correlation therebe- 
tween is higher. Therefore, when the accumulation value of square errors or absolute errors is used as the evaluation 
value, the evaluation value is smaller as the correlation is higher. 

[0006] A motion vector is detected for the purpose of detecting, in the search frame, a Nock where a coding amount 
25 can be most effectively reduced in the motion compensative prediction coding. Accordingly, the accuracy in detecting a 
motion vector is one of significant performances of a motion vector detecting device. The motion vector detection is. 
however, a process requiring a particularly large amount of calculation in an image coding algorithm. Therefore, when 
the motion vector detection is realized by hardware, power consumption is disadvantageous^ large because the proc- 
ess requires a long period of time and a large hardware scale. Furthermore, a real time process of the detection using 
30 software is very difficult to execute at present. Under such circumstances, it is desired to realize motion vector detection 
having high accuracy and high processing efficiency. 

[0007] In some of conventional motion vector detecting devices, a search range is made small with regard to an image 
with small movement, so as to shorten a processing time for the detection of a motion vector, and a search range is 
enlarged with regard to an image with large movement. Thus, the processing efficiency can be improved without 

35 degrading the detection accuracy. 

[0008] For example, a motion vector detecting device disclosed in Japanese Laid-Open Patent Publication No. 8- 
32969 comprises means for evaluating correlation with a block in the same position as a process block, means for 
selectively controlling the size of a search range in accordance with the correlation evaluation of the block, and means 
for detecting a motion vector by evaluating correlations with respective candidate blocks in the search range. In this 

40 device, the search range is reduced as the correlation of the block in the same position is increased. As a result, a 
motion vector can be accurately detected with a small amount of calculation. 
[0009] Such a conventional motion vector detecting device has, however, the following problems: 
[001 0] A picture shot by a camera or the like occasionally includes so-called pan images in which the entire image is 
moved in a given direction. In a pan image, a shot substance itself is not changed but the position thereof is moved in 

45 the given direction. 

[001 1 ] In the aforementioned conventional motion vector detecting device, the size of the search range is set through 
the correlation evaluation with a block in the same position as the process block. Therefore, for example, in a pan image, 
the correlation in the same position is small, and hence, a large search range is inevitably set. Also, prior to the motion 
vector detection, it is necessary to execute the correlation evaluation in the same position, and hence, the process can 
so be disadvantageous^ complicated. 

SUMMARY OF THE INVENTION 

[0012] The object of the invention is realizing accurate and efficient motion vector detection with regard to images 
55 having a variety of characteristics, and in particular, realizing precise and rapid motion vector detection with regard to a 
pan image. 

[001 3] Specifically, the motion vector detecting device of this invention comprises motion vector detecting means for 
calculating a correlation evaluation value indicating correlation between a coding target block in a target frame and a 
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candidate block within a search range of a search frame and for detecting a motion vector with regard to the coding tar- 
get block on the basis of the correlation evaluation values; original search range storing means for storing pixel data of 
an original search range and for supplying pixel data read in accordance with a given memory address to the motion 
vector detecting means; control means for generating a first search width that is a pixel width in the horizontal direction 
s of the search range, a second search width that is a pixel width in the vertical direction of the search range and an offset 
value indicating a relative position of the search range to the original search range; and address generating means for 
generating the memory address supplied to the original search range storing means on the basis of the first and second 
search widths and the offset value generated by the control means. 

[0014] Preferably, in the motion vector detecting device, the motion vector detecting means supplies, to the control 
w means, a detected motion vector and a correlation evaluation value corresponding to the motion vector, and the control 
means generates the first and second search widths and the offset value on the basis of the motion vector and the cor- 
relation evaluation value supplied by the motion vector detecting means. 

[001 5] Furthermore, the method of this invention of detecting a motion vector with regard to a coding target block com- 
prises a first step of determining whether or not a predetermined area in a target frame includes a portion similar to the 

is coding target block; a second step of, when it is determined that a similar portion is included in the first step, setting a 
first area in the search frame including the similar portion and smaller than the predetermined area as a search range 
for motion vector detection; and a third step of, when it is determined that a similar portion is not included in the first 
step, setting an area larger than the first area as the search range lor motion vector detection. 
[001 6] Preferably, in the method of detecting a motion vector, determination of the first step is made on the basis of a 

so correlation evaluation value corresponding to a motion vector detected with regard to a range setting reference block 
that is a block in the same position as or in the vicinity of the coding target block in a frame previous to a target frame, 
and in the second step, a position of the search range is set on the basis of the motion vector detected with regard to 
the range setting reference block. 

[0017] Preferably, in the method of detecting a motion vector, the first step includes a step of executing a predeter- 

25 mined pixel calculation on each of a unit area including at least a part of the coding target block and plural comparison 
areas each having the same size as the unit area and provided in the vicinity of the same position as the coding target 
block in the search frame, and determination of the first step is made on the basis of results of the pixel calculation, and 
in the second step, a comparison area most similar to the unit area is selected from the plural comparison areas on the 
basis of the results of the pixel calculation, and a position of the search range is set on the basis of a position of the 

30 selected comparison area. 

[0018] Moreover, the method of detecting a motion vector of this invention comprises a search range setting step of 
setting a search range for motion vector detection; and a motion vector detecting step of detecting a motion vector with 
regard to a coding target block on the basis of correlation with a candidate block in the search range, wherein the search 
range setting step includes a step of setting a size of the search range on the basis of a correlation evaluation value 

35 corresponding to a motion vector detected with regard to a range setting reference block that is a block in the same 
position as or in the vicinity of the coding target block in a frame previous to a target frame. 
[0019] Alternatively, the method of detecting a motion vector of this invention comprises a search range setting step 
of setting a search range for motion vector detection; and a motion vector detecting step of detecting a motion vector 
with regard to a coding target block on the basis of correlation with a candidate block in the search range, wherein the 

40 search range setting step includes a step of setting a position of the search range is set on the basis of a motion vector 
detected with regard to a range setting reference block that is a block in the same position as or in the vicinity of the 
coding target block in a frame previous to a target frame. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

[0020] 

Figure 1 is a diagram for illustrating a first embodiment of the invention, and shows timewise continuous three frame 
images corresponding to a panned picture; 
so Figures 2(a) and 2(b) are schematic diagrams for showing examples of a search range for motion vector detection 
according to the first embodiment, wherein Figure 2(a) shows an example of a large search range and Figure 2(b) 
shows an example of a small search range; 

Figure 3 is a diagram for showing the structure of a motion vector detecting device according to an embodiment of 
the invention; 

55 Figure 4 is a flowchart for showing an operation of a control unit of the first embodiment; 
Figure 5 is a block diagram for showing the configuration of an address generation unit; 
Figure 6 is a diagram for showing a relationship between an original search range and a search range for motion 
vector detection; 



3 



EP 0 896 300 A2 



Figure 7 is a diagram for showing a result of mapping of two-dimensional pixel data of Figure 6 in a one-dimen- 
sional address space of a search range storing memory; 

Figure 8 is a timing chart for showing an operation of the address generation unit of the first embodiment; 
Figure 9 is a flowchart for showing an operation of a control unit according to a modification of the first embodiment; 
5 Figures 10(a) through 10(c) are schematic diagrams for showing examples of a search range for motion vector 
detection according to the modification of the first embodiment; 

Figure 11 is a diagram for showing a relationship between an original search range and a search range for the 
motion vector detection; 

Figure 12 is a diagram for showing a result of mapping of two-dimensional pixel data of Figure 11 in a one-dimen- 
w sional address space of a search range storing memory; 

Figure 13 is a timing chart for showing an operation of an address generation unit according to the modification of 
the first embodiment; 

Figure 14 is a diagram for showing an exemplified setting of comparison areas in a search frame according to a 
second embodiment of the invention; 
75 Figure 1 5 is a flowchart for showing an operation of a control unit of the second embodiment; and 
Figure 16 is a diagram for illustrating a block matching method. 

DETAILED DESCRIPTION OF THE INVENTION 

20 EMBODIMENT 1 

[0021] Figure 1 is a diagram for showing timewise continuous three frame images, corresponding to a so-called 
panned picture shot with a camera moved in a leftward direction. When a panned picture is seen in a very short period 
of time, it can be said, in general, that a shot substance is moving at a given rate. Accordingly, in a first embodiment, in 

25 detecting a motion vector MV with regard to a coding target block CB in a target frame (frame (1)), a block AB of a 
search frame (frame (0)) in the same position as the coding target block CB is set as a range setting reference block, 
and on the basis of a motion vector BMV detected with regard to the range setting reference block AB and a correlation 
evaluation value BAE corresponding to the motion vector BMV, the size and the position of a search range are deter- 
mined. In this manner, as is shown in Figure 1 . a search range for the motion vector detection can be narrowed down 

30 to and set in an area where the image of the coding target block CB is estimated to be present in the search frame. 
Accordingly, a motion vector can be accurately and rapidly detected. 

[0022] Figures 2(a) and 2(b) are schematic diagrams for showing examples of the search range for the motion vector 
detection according to this embodiment. In this embodiment, the search range can be in any of two types of sizes. Fig- 
ures 2(a) and 2(b) show examples of the search range for the coding target block CB having a general size (i.e., 16 pix- 

35 els in the horizontal direction by 16 pixels in the vertical direction) of an image coding standard such as MPEG. Figure 
2(a) shows a search range of 46 pixels in the horizontal direction by 46 pixels in the vertical direction as an example of 
a large search range W, and Figure 2(b) shows a search range of 30 pixels in the horizontal direction by 30 pixels in the 
vertical direction as an example of a small search range S. The position of the small search range S is expressed by 
using a relative position to the large search range W. In this case, a vector starting at the upper left corner, that is, the 

40 search start point of the search range W and ending at the upper left corner, that is, the search start point of the search 
range S is defined as an offset (Hoff, Voff). and the position of the search range S is expressed by using offset values 
corresponding to the components of the offset. At this point, for example, when a picture is a still image and the search 
range S is set in the position of the coding target block CB, the offset values are, as is shown in Figure 2(b): 

45 Hoff = 8 

Voff = 8 

Furthermore, a pixel width along the horizontal direction of the search range is designated as a search horizontal (H) 
so pixel width corresponding to a first search width, and a pixel width along the vertical direction of the search range is des- 
ignated as a search vertical (V) pixel width corresponding to a second search width. 

[0023] Figure 3 is a diagram for showing the structure of a motion vector detecting device of this embodiment. In Fig- 
ure 3. a reference numeral 10 denotes an address generation unit for generating a memory address MA on the basis 
of a search H pixel width, a search V pixel width and an offset, a reference numeral 20 denotes a search range storing 
55 memory corresponding to original search range storing means for storing image data of an original search range, a ref- 
erence numeral 30 denotes a motion vector detection unit for calculating an evaluation value indicating correlation 
between a coding target block and a candidate block in a search range and for outputting a motion vector corresponding 
to the highest correlation and an evaluation value corresponding to this motion vector, a reference numeral 40 denotes 
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a control unit for determining a search H pixel width, a search V pixel width and an offset on the basis of the motion 
vector and the evaluation value output by the motion vector detection unit 30 and outputting the calculated values to the 
address generation unit 1 0, and a reference numeral 50 denotes a coding target block storing memory for storing image 
data of a coding target block. Here, the original search range is the large search range W of 46 pixels by 46 pixels, 
s [0024] Figure 4 is a flowchart for showing an operation of the control unit 40. Now, the operation of the control unit 40 
will be described with reference to the flowchart of Figure 4 and Figure 1 . 

[0025] It is herein assumed that the search range tor the motion vector detection is to be set with regard to the coding 
target block CB in the target frame. The control unit 40 supplies, to the address generation unit 10, a search H pixel 
width, a search V pixel width and an offset representing the search range and determined on the basis of the motion 
w vector BMV with regard to the range setting reference block AB in the search frame and the correlation evaluation value 
BAE corresponding to the motion vector BMV. 

[0026] In a step SI , the correlation evaluation value BAE corresponding to the range setting reference block AB is 
compared with a threshold value AE0. When the evaluation value BAE is found to be larger than the threshold value 
AE0 as a result of the comparison, it is determined that there is no portion similar to the coding target block CB in a 
is predetermined area in the search frame because the correlation of the motion vector BMV is small. Therefore, without 
narrowing down the search range, the targe search range W of 46 pixels by 46 pixels, that is the original search range, 
is set as the search range for the motion vector detection (step S2). Specifically, in this case, both the search H pixel 
width and the search V pixel width are defined as "46" and the offset is defined as (0, 0). 

[0027] When the correlation evaluation value BAE corresponding to the range setting reference block AB is not larger 
20 than the threshold value AE0, it is determined that there is a portion simitar to the cocfing target block CB in the prede- 
termined area in the search frame because the correlation of the motion vector BMV is large. Therefore, the small 
search range S of 30 pixels by 30 pixels is set as the search range for the motion vector detection (step S3). Then, in a 
step S4, the size of the motion vector BMV, i.e., |BMV (x, y)|, of the range setting reference block AB is compared with 
a threshold value MV0. 

25 [0028] When the size of the motion vector BMV is found to be larger than the threshold value MV0 as a result of the 
comparison, it is determined that the movement of the coding target block CB is large, and the offset is set by using the 
components of the motion vector BMV (step S5). Specifically, the components of the offset (Hoff, Voff) are set as fol- 
lows: 

30 Hoff = x + 8 

Voff = y + 8 

In other words, in this case, both the search H pixel width and the search V pixel width are defined as "30" and the offset 
35 is defined as (x+8, y+8). 

[0029] When the size of the motion vector BMV is not larger than the threshold value MV0, it is determined that the 
movement of the coding target block CB is small and that the image therein is still, and the offset is set at (8. 6). Spe- 
cifically, in this case, both the search H pixel width and the search V pixel width are defined as "30" and the offset is 
defined as (8, 8). 

40 [0030] The address generation unit 10 generates a memory address MA on the basts of the search H pixel width, the 
search V pixel width and the offset output by the control unit 40. The motion vector detection unit 30 detects a motion 
vector with regard to the coding target block CB by using pixel data of the search range read from the search range stor- 
ing memory 20 (step S10). 

[0031] Figure 5 is a block diagram for showing the configuration of the address generation unit 10. As is shown in 
45 Figure 5, the address generation unit 10 includes an H counter 11 as a first counter for counting a clock, an H compa- 
rator 12 as a comparator for comparing the search H pixel width and the count value of the H counter 11, resetting the 
count value of the H counter 11 when the compared values are the same, and outputting a count-up signal CU, a V 
counter 13 as a second counter for counting the count-up signal CU, a V comparator 14 for comparing the search V 
pixel width and the count value of the V counter 13 and generating an actuation signal for completing the operation of 
so the motion vector detection unit 30 when the compared values are the same, and a memory address converter 15 for 
generating the memory address MA of the search range storing memory 20 on the basis of the offset and the count 
values of the H counter 11 and the V counter 13. The H counter 1 1 and the V counter 13 are reset in accordance with 
a start signal supplied by the control unit 40, so that the address generation unit 10 can be actuated. 
[0032] Now, the operation of the address generation unit 10 of Figure 5 wilt be described with reference to Figures 6 
55 through 8. 

[0033] Figure 6 is a diagram for showing a relationship between an original search range stored in the search range 
storing memory 20 and a search range for the motion vector detection. As is shown in Figure 6, it is herein assumed 
that the search range storing memory 20 stores pixel data of 12 pixels in the horizontal direction by 8 pixels in the ver- 
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tical direction as the original search range, and that a search range determined by the search H pixel width of 8, the 
search V pixel width of 6 and the offset of (2, 1) is set as the search range for the motion vector detection. 
[0034] Figure 7 is a diagram resulting from mapping of the two-dimensional pixel data of Figure 6 in a one-dimensional 
address space of the search range storing memory 20. The address generation unit 1 0 generates the memory address 
MA to be used for reading the pixel data of the search range for the motion vector detection from the search range stor- 
ing memory 20. Figure 8 is a timing chart for showing the operation of the address generation unit 10. As is shown in 
Figure 8. when the start signal is input, the H counter 1 1 starts counting the clock. When the count value of the H coun- 
ter 11 becomes equal to a value indicating the search H pixel width, the H counter 12 outputs the count-up signal CU. 
thereby resetting the count value of the H counter 1 1 . The V counter 13 counts the count-up signal CU. When the count 
value of the V counter 13 becomes equal to a value indicating the search V pixel width, the V comparator 14 outputs 
the actuation signal. . 

[0035] In response to the offset (Hoff, Voff), the memory address convertor 1 5 calculates an address SAO as a start- 
ing point of the search range for the motion vector detection on the basis of a pixel width Hmax in the horizontal direc- 
tion and a pixel width Vmax in the vertical direction of the original search range stored in the search range storing 
memory 20. The starting address SAO is obtained by the following formula: 

SAO = Hmax x Voff + Hoff 

[0036] In the case exemplified in Figure 6, the starting address SAO is: 

SA0=12x1+2 = 14 

[0037] Then, the memory address convertor 1 5 calculates the memory address MA by the following formula: 
MA = SAO + Hmax x (the count value of the V counter 13) 
+ the count value of the H counter 11 

As a result, the memory address MA is varied as is shown in Figure 8. Fa example, from the starting address SAO up 
to an address corresponding to the search H pixel width, the memory address MA can be obtained by adding the count 
value of the H counter 1 1 to the starting address SAO as is shown in Figure 7. In response to the input of a subsequent 
clock, the count value of the H counter 1 1 is set at 0 and the count value of the V counter 1 3 is set at 1 . At this point, 
the memory address MA is: 

MA = 14+ 12x1 +0 = 26 

[0038] In this manner, according to this embodiment, a motion vector can be accurately and efficiently detected even 
in a panned picture. 

[0039] In this embodiment, a block of the search frame in the same position as the coding target block is used as the 
range setting reference block. Instead, a block of the search frame in the vicinity of the same position as the coding tar- 
get block can be used as the range setting reference block. Also, a block in the same position or in the vicinity of the 
same position as the coding target block in a frame further preceding the search frame can be used as the range setting 
reference block. 

[0040] Furthermore, although the search range of this embodiment has two types of sizes, the search range can be 
in a larger number of types of sizes. Also, the search H pixel width and the search V pixel width can be made variable, 
with the components of a motion vector with regard to a range setting reference block used as an evaluation index. 

MODIFICATION OF EMBODIMENT 1 

[0041] In the first embodiment, subsampling can be also adopted. In this case, the control unit 40 inputs to the 
address generation unit 1 0, in addition to the search H pixel width, the search V pixel width and the offset value, a sub- 
sample number DH in the horizontal direction of the search range as a first subsample number and a subsample 
number DV in the vertical direction as a second subsample number. 

[0042] Figure 9 is a flowchart for showing the operation of the control unit 40 according to this modification. This flow- 
chart is different from that shown in Figure 4 in specifying whether or not subsampling is executed in addition to setting 
the size and the position of the search range. Specifically, in a step S2 A for setting the large search range W and in a 
step S5A for setting the small search range S in a position other than the position of the coding target block CB, the 
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execution of subsampling is specified, in a step S6A for setting the small search range S in the same position as the 
coding target block CB, the executing of subsampling is not specified. 

[0043] Figures 1 0(a) through 1 0(c) are schematic diagrams for showing examples of the search range for the motion 
vector detection according to this modification. In this case, the subsample number DH in the horizontal direction and 

5 the subsample number DV in the vertical direction are both set at 2. Figure 10(a) shews an example of the large search 
range W adopted when the executing of subsampling is specified, Figure 10(b) shows an example of the small search 
range S adopted when the execution of subsampling is specified, and Figure 10(c) shows an example of the small 
search range S adopted when the execution of subsampling is not specified. In the step S6A, it is because the move- 
ment of the coding target block CB is determined to be small that the small search range S is set in the same position 

w as the coding target block CB. In this case, since degradation of the detection accuracy is undesirable, the execution of 
subsampling is not specified as is shown in Figure 10(c). 

[0044] Now, the operation of the address generation unit 10 of this modification will be described with reference to 
Figures 11 through 13. 

[0045] Figure 1 1 is a diagram for showing the relationship between an original search range stored in the search 
is range storing memory 20 and a search range for the motion vector detection. It is herein assumed, as is shown in Fig- 
ure 11 , that the search range for the motion vector detection is determined by defining the search H pixel width as 6, 
the search V pixel width as 4, the offset as (0, 0), and both the subsample numbers DH and DV as 2. 
[0046] Figure 12 is a diagram resulting from mapping the two-dimensional pixel data of Figure 11 in a one-dimen- 
sional address space of the search range storing memory 20. 
20 [0047] Figure 1 3 is a timing chart for showing the operation of the address generation unit 10. In this modification, the 
memory address convertor 15 calculates a memory address MA by the following formula: 

MA = SAO + Hmax x (the count value of the V counter 13) x 

25 £)V 

As a result, the memory address MA is varied as is shown in Figure 12. 
30 EMBODIMENT 2 

[0048] In a second embodiment of the invention, plural blocks having the same size as a coding target block are set 
in the search frame in the vicinity of the same position as the coding target block, and a predetermined pixel calculation 
is conducted with regard to the coding target block and each of the plural blocks set in the search frame. On the basis 

35 of the results of the calculation, the size and the position of the search range for the motion vector detection are set. 
Herein, an accumulating calculation of pixel data in the block is performed as the predetermined pixel calculation. 
[0049] Figure 14 is a diagram for showing an example of the blocks set in the search frame according to this embod- 
iment. In Figure 14, with regard to a coding target block CB of 16 pixels by 16 pixels as a unit area, nine blocks SB0 
through SB8 each of 16 pixels by 16 pixels are set in the search frame as comparison areas. 

ao [0050] A motion vector detecting device of this embodiment has the structure as is shown in Figure 3 similarly to that 
of the first embodiment. However, the control unit 40 does not receive a motion vector and an evaluation value output 
by the motion vector detection unit 30 but receives image data of each frame instead. 

[0051] Figure 15 is a flowchart for showing the operation of the control unit 40 of the motion vector detecting device 
of this embodiment. First, in a step S21, with regard to the coding target block and each block set in the search frame, 

45 the accumulating calculation of the pixel data of the block is executed. In a step S22, a minimum absolute value SAmin 
of a difference between an accumulation result AC(CB) of the coding target block and an accumulation result AC(SBn) 
(wherein n = 0 through 8) of each block set in the search frame is compared with a threshold value SAO. When the min- 
imum value SAmin is found to be larger than the threshold value SAO as a result of the comparison, it is determined 
that there is no portion similar to the coding target block CB in a predetermined area in the search frame. Therefore, 

so without narrowing down the search range, the targe search range W of 46 pixels by 46 pixels is set as the search range 
for the motion vector detection (step S23) Specifically, in this case, both the search H pixel width and the search V pixel 
width are defined as "46" and the offset is defined as (0, 0). 

[0052] When the minimum value SAmin is not larger than the threshold value SAO, it is determined that there is a 
portion similar to the coding target block CB in the predetermined area in the search frame. Therefore, the small search 
55 range S of 30 pixels by 30 pixels is set as the search range for the motion vector detection (step S24). Then, in a step 
S25, the offset is set so that the search range S can be set in the position of a block SBk when the absolute value of a 
difference between the accumulation result of the block SBk and the accumulation result of the coding target block CB 
is the minimum. 
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[0053] For example, in the case where the block SBO is set in the same position as the coding target block CB and 
the blocks SB1 through SB8 are set around the block SBO. the offset is set at (0, 0) when the absolute value of a dif- 
ference between the accumulation result of the block SBO and the accumulation result of the coding target block CB is 
the minimum. Also, when the absolute value of a difference between the accumulation result of the block SB8 and the 
accumulation result of the coding target block CB is the minimum, the offset is set at (16. 16). 
[0054] In this manner, according to this embodiment, the offset is set without using a motion vector detected in a pre- 
vious frame. Therefore, the offset can be set in an initial frame in the motion vector detection. As a result, a motion vec- 
tor can be detected more efficiently than in the first embodiment. 

[0055] Alternatively, with defining a part of the coding target block as a unit area and with setting plural comparison 
areas each having the same size as the unit area, a predetermined pixel calculation can be executed on each of these 
areas. Also, the unit area can include an area in the vicinity of the coding target block. Moreover, the unit area can be 
in any shape. 

[0056] As the predetermined pixel calculation, for example, an accumulating calculation of a difference between adja- 
cent pixels, a variance calculation of pixels or a frequency distribution calculation of pixels can be adopted in stead of 
the accumulating calculation. In addition, a calculation result can be provided with a weighting in accordance with the 
position of the area. 

[0057] It is noted that the present invention is easily applicable to motion vector detection in accordance with rotation 
or enlargement/reduction of an image. 

Claims 

1 . A motion vector detecting device comprising: 

motion vector detecting means for calculating a correlation evaluation value indicating correlation between a 
coding target block in a target frame and a candidate block within a search range of a search frame and for 
detecting a motion vector with regard to said coding target block on the basis of said correlation evaluation val- 
ues; 

original search range storing means for storing pixel data of an original search range and for supplying pixel 

data read in accordance with a given memory address to said motion vector detecting means; 

control means for generating a first search width that is a pixel width in the horizontal direction of said search 

range, a second search width that is a pixel width in the vertical direction of said search range and an offset 

value indicating a relative position of said search range to said original search range; and 

address generating means for generating said memory address supplied to said original search range storing 

means on the basis of said first and second search widths and said offset value generated by said control 

means. 

2. The motion vector detecting device of Claim 1 , 

wherein said motion vector detecting means supplies, to said control means, a detected motion vector and 
a correlation evaluation value corresponding to said motion vector, and 

said control means generates said first and second search widths and said offset value on the basis of said 
motion vector and said correlation evaluation value supplied by said motion vector detecting means. 

3. The motion vector detecting device of Claim 2, 

wherein said control means defines a block in the same position as or in the vicinity of said coding target 
block in a frame previous to said target frame as a range setting reference block, and sets a size of said search 
range on the basis of a correlation evaluation value corresponding to said range setting reference block. 

4. The motion vector detecting device of Claim 2, 

wherein said control means defines a block in the same position as or in the vicinity of said coding target 
block in a frame previous to said target frame as a range setting reference block, and sets a position of said search 
range on the basis of a motion vector with regard to said range setting reference block. 

5. The motion vector detecting device of Claim 2, 

wherein said control means defines a block in the same position as or in the vicinity of said coding target 
block in a frame previous to said target frame as a range setting reference block, and sets said original search 
range as said search range when correlation indicated by a correlation evaluation value corresponding to said 
range setting reference block is comparatively small, while sets a size of said search range to be smaller than a size 
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of said original search range and sets a position of said search range on the basis of a motion vector with regard 
to said range setting reference block when correlation indicated by the correlation evaluation value of said range 
setting reference block is comparatively large. 



5 6. The motion vector detecting device of Claim 1 , 

wherein said offsel value corresponds to components of a vector starting at a search start point of said orig- 
inal search range and ending at a search start point of said search range. 

7. The motion vector detecting device of Claim 1 , 
io wherein said address generating means includes: 



a first counter for counting a clock; 

a comparator for comparing said first search width with a count value of said first counter and, when said first 
search width accords with the count value, resetting the count value of said first counter and outputting a count- 
up signal; 

a second counter for counting said count-up signal; and 

a memory address converter for generating said memory address supplied to said original search range stor- 
ing means in accordance with a predetermined formula on the basis of said offset value and the count values 
of said first and second counters. 

The motion vector detecting device of Claim 1 , 

wherein sard control means generates, in addition to said first and second search widths and said offset 
value, a first subsample number corresponding to a subsampling rate in the horizontal direction of said search 
range and a second subsample number corresponding to a subsampling rate in the vertical direction of said search 
range, and 

said address generating means generates said memory address supplied to said original search range storing 
means on the basis of said first and second search widths, said first and second subsample numbers and said 
offset value generated by said control means. 

A method of detecting a motion vector with regard to a coding target block, comprising: 

a first step of determining whether or not a predetermined area in a target frame includes a portion similar to 
said coding target block; 

35 a second step of, when it is determined that a similar portion is included in said first step, setting a first area in 

said search frame including said similar portion and smaller than said predetermined area as a search range 
for motion vector detection; and 

a third step of, when it is determined that a similar portion is not included in said first step, setting an area larger 
than said first area as said search range for motion vector detection. 

AO 

1 0. The method of detecting a motion vector of Claim 9, 

wherein, determination of said first step is made on the basis of a correlation evaluation value corresponding 
to a motion vector detected with regard to a range setting reference block that is a block in the same position as or 
in the vicinity of said coding target block in a frame previous to a target frame, and 

45 

in said second step, a position of said search range is set on the basis of said motion vector detected with 
regard to said range setting reference block. 

The method of detecting a motion vector of Claim 9, 

wherein sard first step includes a step of executing a predetermined pixel calculation on each of a unit area 
including at least a part of said coding target block and plural comparison areas each having the same size as said 
unit area and provided in the vicinity of the same position as said coding target block in said search frame, and 
determination of said first step is made on the basis of results of said pixel calculation, and 

55 in said second step, a comparison area most similar to said unit area is selected from said plural comparison 

areas on the basis of the results of said pixel calculation, and a position of said search range is set on the basis 
of a position of said selected comparison area. 
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12. A method of detecting a motion vector comprising: 

a search range setting step of setting a search range for motion vector detection; and 
a motion vector detecting step of detecting a motion vector with regard to a coding target block on the basis of 
5 correlation with a candidate block in said search range, 

wherein said search range setting step includes a step of setting a size of said search range on the basis of a 
correlation evaluation value corresponding to a motion vector detected with regard to a range setting reference 
block that is a block in the same position as or in the vicinity of said coding target block in a frame previous to 
a target frame. 

10 

1 3. A method of detecting a motion vector comprising: 

a search range setting step of setting a search range for motion vector detection; and 
a motion vector detecting step of detecting a motion vector with regard to a coding target block on the basis of 
15 correlation with a candidate block in said search range, 

wherein said search range setting step includes a step of setting a position of said search range on the basis 
of a motion vector detected with regard to a range setting reference block that is a block in the same position 
as or in the vicinity of said coding target block in a frame previous to a target frame. 

20 



25 



30 



35 



40 



45 



SO 



kierwin. -CD naoainnAO 



10 



EP 0 896 300 A2 



Fig.l 



rame (- 1 ) 



BMV(BAE) 




F rame ( 0 ) 
(Search frame) 

S(0) 



^( 1) Movement of 



camera 



MV 




W(0) 



CB 



F rame ( 1 ) 
(Target frame) 



Passage of time 




11 



EP 0 896 300 A2 




Search range W 



46 



Fig. 2 (b) 



Offset 
(Hoff, Voff) 




Search range S 



30 



12 



EP 0 896 300 A2 



CO 
c 



CO 
* 

• r-H 




13 



EP 0 896 300 A2 



Fig .4 



( S tart ) 




Yes 





No 


Search range S 







S3 



S4 




Yes 





«e 




Motion vector 
detection 



S5 

rL 



Offset (Hoff, Voff) 
/Hoff<-x + 8 
I Voff«-y+8 



S2 

rL 



Search range W 
Offset(0, 0) 



S10 



\ r 

( End ) 



14 



EP 0 896 300 A2 



LTD 

» 



5° 



CD 



> 
o 

CO 



-a 

i — ' 

a 
X 

CJ 
CO 

CO 



CO 



o 
a 

> 



3 



O 

O 



w 
OS 



i 

a 

£ 



c 
bo 

•r-t 

CO 
4-> 

cd 

4-> 

CO 



o 
o 

1 — I 

o 



CO 

13 



> 



O 

Jh 
CD 
> 

c 
o 
o 

CO 

w 



13 



cu 



<4H 

o 



I 

CO 

c 
o 

1 

o 

< 



CO 
CO 



15 



EP 0 896 300 A2 



F ig .6 

Offset (2, 1) 

23456789 10 11 



0 
1 
2 
3 
4 
5 
6 
7 




oooooooooo 

OC700000000OO 
OO00000000OO 
OO00000000OO 
OO00000000OO 
OO00000000OO 
OO00000000OO 

oooooooooooo 



8 



16 



t 

EP0 896 300 A2 



Fig .7 



SAO 



0 


O 


1 


0 


2 


O 


3 


o 


4 


o 


5 


o 


6 


o 


/ 


o 


8 


o 


9 


o 


10 


o 


11 


o 


12 


o 


13 


o 


14 




15 




16 




17 




18 




19 




20 




21 




22 


o 


23 


o 


24 


o 


25 


o 


26 


• 


95 


o 



Hmax 



Search H pixel width 



17 



EP 0 896 300 A2 




18 



EP 0 896 300 A2 



Fig .9 



( S tart ) 




Yes 



> 


No 


Search range S 


> 


f 



S3 



BMV(x, y)|>MVO 
No 



Yes 



S6A 



No-Subsampling 
Offset (8, 8) 



S5A 



S ubsampling 

Offset (Hoff, Voff) 
JHoff<-x+8 
1 Voff*-y+8 



S2A 



S ubsampling 
Search range W 
Offset(0, 0) 



Motion vector 
detection 



SI 0 



V 

( End ) 



19 



EP0 896300 A2 



Fig. 10(a) 



M M M M 1 



S earch range W 




46 



46 



Fig. 10(b) 



Offset 
(Hoff, Voff) 



Search range S 

Fig. 10(c) 




Search range S 




20 



EP 0 896 300 A2 



Fig. 11 



Offset (0, 0) 




0123456789 10 11 



O0O0O0O0O0O 

oooooooooooo 

0O0O0O0O0O0O 

oooooooooooo 

0O0O0O0O0O0O 
OOOOOOOOOOOO 
0O0O0O0O0O0O 
OOOOOOOOOOOO 



4 (DV=2) 



6 (DH=2) 



21 



EP 0 896 300 A2 



Fig. 12 



SAO 



DH 



0 


• 


1 


O 


2 


• 


3 


0 


4 


• 


5 


o 


6 


• 


7 


o 


8 


• 


9 


o 


10 


• 


11 


o 


12 


o 


13 


o 


14 


o 


15 


o 


16 


o 


17 


o 


18 


o 


19 


o 


20 


o 


21 


o 


22 


o 


23 


o 


24 


• 


25 


o 


26 


• 


94 


o 


95 


o 



HmaxXDV 



22 



EP0896 300 A2 




23 



EP 0 896 300 A2 



F ig .14 



Search frame 



SBl 


SB2 


SB3 


SB4 


SBO 


SB 5 


SB6 


SB 7 


SB 8 



<L > 

16 



Target frame 




24 



EP 0 896 300 A2 



F ig .15 



( S tart ) 



S21 



Accumulating calculation of each block 



S22 




Yes 



S24 



Search range S 



S25 



Set offset in position of SBk 
(| AC (C B)-AC (S Bk ) | = S A mi n ) 



Motion vector 
detection 



SI 0 



S23 



Search range W 
Offset (0, 0) 



25 



EP0 896 300 A2 



F ig .16 



Best match block 




— * — • \ 

\ Coding target block 




26 



(19) 



J 





(12) 



Europaisches Patentamt 
European Patent Office 

Office europeen des brevets (1 1 ) EP 0 896 300 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

08.09.1999 Bulletin 1999/36 

(43) Date of publication A2: 

10.02.1999 Bulletin 1999/06 

(21) Application number: 98114578.2 

(22) Date of filing: 03.08.1998 



<51) Int. CI 6 : G06T 7/20, H04N5/14, 
H04N 7/36 



(84) Designated Contracting States: 


(72) 


Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• 


Ohtani, Akihiko 


MCNLPT SE 




Minoo-shi, Osaka 562-0005 (JP) 


Designated Extension States: 


• 


Aoki, Katsuji 


AL LT LV MK RO SI 




Kawasaki-shi, Kanagawa 216-0015 (JP) 




• 


Araki, Toshiyuki 


(30) Priority: 07.08.1997 JP 21282697 




Ibaraki-shi, Osaka 567-0825 (JP) 


(71) Applicant: 


(74) 


Representative: 


Matsushita Electric Industrial Co., Ltd. 




Grunecker, Kinkeldey, 


Kadoma-shi, Osaka 571-8501 (JP) 




Stockmair & SchwanhSusser 






Anwaltssozietat 






Maximilianstrasse 58 






80538 Munchen (DE) 



CO 

< 

o 
o 

CO 

CD 
O) 
00 



(54) Device and method for motion vector detection 
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motion vector detection unit detects a motion vector with 
regard to a coding target block on the basis of correla- 
tion with a candidate block within a search range. A 
search range storing memory stores pixel data of an 
original search range, and supplies, to the motion vector 
detection unit, pixel data of a search range in accord- 
ance with a memory address. A control unit sets the 
size and the position of the search range on the basis of 
the motion vector and the correlation evaluation value 
supplied from the motion vector detection unit, and gen- 
erates pixel widths in the horizontal and vertical direc- 
tions of the search range and an offset value 
corresponding to the relative position to the original 
search range. An address generation unit generates the 
memory address to be supplied to the search range 
storing memory on the basis of the pixel widths and the 
offset value of the search range generated by the con- 
trol unit. 
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